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Abstract 

We consider the Lagrange problem of optimal control with unre- 
stricted controls and address the question: under what conditions we 
can assure optimal controls are bounded? This question is related to 
the one of Lipschitzian regularity of optimal trajectories, and the an- 
swer to it is crucial for closing the gap between the conditions arising 
in the existence theory and necessary optimality conditions. Rewrit- 
ing the Lagrange problem in a parametric form, we obtain a relation 
between the applicability conditions of the Pontryagin maximum prin- 
ciple to the later problem and the Lipschitzian regularity conditions 
for the original problem. Under the standard hypotheses of coercivity 
of the existence theory, the conditions imply that the optimal controls 
are essentially bounded, assuring the applicability of the classical nec- 
essary optimality conditions like the Pontryagin maximum principle. 
The result extends previous Lipschitzian regularity results to cover 
optimal control problems with general nonlinear dynamics. 

Keywords: optimal control - Pontryagin maximum principle - bounded- 
ness of minimizers - nonlinear dynamics - Lipschitzian regularity. 



1 Introduction 

Given a Lagrangian L : R x R n x W — > R, a dynamical equation x{t) = 
(p(t, x(t), u(t)), and boundary conditions x(a) = A, x(b) = B G R™, we 
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consider the problem of finding a control u(-) £ L\ ([a, b]; M r ) such that 
the corresponding state trajectory x(-) € W\ t \ ([a, b]; M. n ) of the dynamical 
equation satisfies the boundary conditions, and the pair (x(-), «(■)) min- 
imizes the functional J[x(-), «(•)] := J^L(t, x(t), u(t))dt. We establish 
Lipschitzian regularity conditions for the minimizing trajectories of such op- 
timal control problems. Lipschitzian regularity has a number of important 
implications. For example in control engineering applications, where opti- 
mal strategies are implemented by computer, the choice of discretization and 
numerical procedures depends on minimizer regularity H 34 1. Lipschitzian 
regularity of optimal trajectories also precludes occurrence of the undesirable 
Lavrentiev phenomenon |25], pi |23|, [22j and provides the validity of known 
necessary optimality conditions under hypotheses of existence theory pd| ]. 
The techniques of the existence theory use compactness arguments which 
require to work with measurable control functions from L p , 1 < p < oo ||]. 
On the other hand, standard necessary conditions for optimality, such as 
the classical Pontryagin maximum principle [27], put certain restrictions on 
the optimal controls - namely, a priori assumption that they are essentially 
bounded. Examples are known, even for polynomial Lagrangians and linear 
dynamics [||, for which optimal controls predicted by the existence theory 
are unbounded and fail to satisfy the Pontryagin maximum principle 
If we are able to assure that a minimizer (x(t), u(t)), a < t < 6, of our 
problem is such that u(-) is essentially bounded, then the solutions can be 
identified via the Pontryagin maximum principle. As far as (p(t, x(t), u(t)) 
is bounded, it also follows that the optimal trajectory x(-) is Lipschitzian. 
Similarly, the Hamiltonian adjoint multipliers ip{-) of the Pontryagin max- 
imum principle turn out to be Lipschitzian either. Thus, regularity theory 
justifies searching for minimizers among extremals and establishes a weaker 
form of the maximum principle in which the Hamiltonian adjoint multipliers 
are not required to be absolutely continuous but merely Lipschitzian. 

The study of Lipschitzian regularity conditions has received few atten- 
tion when compared with existence theory or necessary conditions, which 
have been well studied since the fifties and sixties. The question of Lip- 
schitzian regularity, for the general Lagrange problem of optimal control, 
seems difficult, and attention have been on particular dynamics. Most part 
of results in this direction refers to problems of the calculus of variations. 
First results on Lipschitzian regularity for the basic problem of the calculus 
of variations - (p{u) = u — belong to L. Tonelli and S. Bernstein. Some 
further results have been obtained by C. B. Morrey and more recently by 
F. H. Clarke and R. B. Vinter among others. For a survey see || Ch. 2] 
or [35, Ch. 11]. Less is known for the Lagrange problem of optimal control. 
Problems whose dynamics is linear and time invariant - <p(x, u) = Ax + Bu 
- were addressed in 14]. The result is obtained imposing conditions under 
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which the problem is reduced into a problem of the calculus of variations 
and then using the results available in the literature. Recently, a new ap- 
proach to the Lipschitzian regularity has been developed by A. Sarychev and 
the author in p8| , which allows to deal with a wide class of optimal con- 
trol problems with control-affme dynamics - <p(t, x, u) = f(t, x) + g(t, x) u. 
As particular cases they include the problems of the calculus of variations 
treated before. The approach is based in the reduction of the problem to 
a time-optimal control problem, on the subsequent compactification of the 
space of admissible controls, and utilization of the Pontryagin's maximum 
principle . The conditions of Lipschitzian regularity arise from the con- 
ditions of applicability of the Pontryagin's maximum principle |27]] to the 
latter problem and from its equations Lipschitzian regularity of the corre- 
sponding minimizer of the initial problem is established. For a survey see 
[ 29 1 . The main result of |28|] can be summarized in the following theorem: 



Theorem 1 (ip (t, x, u) = f (t, x) + g (t, x) u). If g (i, x) has complete rank 
r for all t and x; L(-, •, •), / (•, •), g (•, •) are C 1 smooth; and the following 
conditions are satisfied: 

(coercivity) there exist a function 9 : M. — > R and ( G R such that 

L(t,x,u)>9(\\u\\)>(, V(t,x,n), 

v 0(r) 

hm = +oo ; 

r— *+oo r 

(growth condition) there exist constants 7, (3, 77 and fi, with 7 > 0, (3 < 2 
and fi > max{/3 — 2, —2}, such that the inequality 

(\L t \ + \L x i\ + \\Ltpt - L t ip\\ + \\Ltp x i - L x i ip\\ ) \\u\f < -yL 13 +77, 

holds for all t £ [a,b], x G R n , u € W , i £ {1, n}; 

then all the minimizers u (•) of the problem, which are not abnormal extremal 
controls, are essentially bounded on [a, b] . 

Results for general nonlinear dynamics, which is nonlinear both in state 
and control variables, are lacking. To deal with the problem we make use of 
a different auxiliary optimal control problem than the one in |28| ] (Section ^), 
which is obtained using an idea of time reparameterization that proved to 



be useful in many different contexts - see e.g. [|T9j, Sec. 10], JT^, 17\, (2^, 
Lec. 13], § p. 46], |], @], @, @, Ch. 5], |J p. 29], and g§. At the core 
of our proof techniques is the study of the relation between the minimizers 
and admissible trajectory-control pairs of the original and auxiliary prob- 
lems (Section [|) and how the Pontryagin extremals are related (Section ||). 
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Applying weak necessary conditions than the Pontryagin's maximum prin- 
ciple p7| ] , for example the ones found in Q , to minimizers of the auxiliary 
problem, then one is able to obtain, from the established relations between 
minimizers and extremals, the desired regularity properties for the minimiz- 
ers of the original problem (Section [B]). Examples which possess minimizers 
according to the existence theory and to which our results are applicable 
while previously known Lipschitzian regularity conditions fail are provided 
(Section |6|). 

2 Formulation of Problems (P), (P T ) and (P T [w( )]) 

We are interested in the study of Lipschitzian regularity conditions for the 
Lagrange problem of optimal control with arbitrary boundary conditions. 
For that is enough to consider the case when the boundary conditions are 
fixed: x{a) = A and x(b) = B. Indeed, if x(-) is a minimizing trajectory 
for a Lagrange problem with any other kind of boundary conditions, then 
x(-) is also a minimizing trajectory for the corresponding fixed boundary 
problem with A = x(a) and B = x(b). The data for our problem is then 



o,kl (a < b) 
A, B € R" 



L : 

<p : I 



(1) 



We assume L(-, •, •), </?(-, •, •) G C, and tp(-, •, u), <p(-, -,u) G C . (Smoothness 
hypotheses on L and ip can be weakened, as is discussed later in connection 
with the Pontryagin maximum principle.) The Lagrange problem of optimal 
control is defined as follows. 

Problem (P). 



/ [ x (.), = / L(t, x(t), u{t)) dt — ► min 



z(-)GWi,i([a, 6];M n ),4)eLi([a, &]; S 
x(t) = ip{t, x(t), u(t)) , a.e. t G [a, b] 
x(a) = A, x(b) = B. 



(2) 



The overdot denotes differentiation with respect to i, while the prime will 
be used in the sequel to denote differentiation with respect to r. To derive 
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conditions assuring that the optimal controls «(■) of problem (P) are essen- 
tially bounded, u(-) G L^, two auxiliary problems, defined with the same 



Problem (P T ). 

J [t(-), «(•), «(•), «;(■)] = / ^ «(r), «j(r)) u(r) dr — ► min 



Remark 2. The fact that the control variable v(-) takes on its values in the 
set [0.5, 1.5], guarantees that t(r) has an inverse function r(t). 
Problem (P) is actually equivalent to problem (P T ), in the sense that prob- 
lem (P) can be formally transformed into problem (P T ) by considering t as 
a dependent variable and introducing a one to one Lipschitzian transforma- 
tion [a, b] 3 t h r £ [ a ,b]- Both problems have the same minimum value 
and a direct relation between admissible state-control pairs (cf. Section ||). 

The following problem is the same as problem (P T ) except that w(-) G 
L\ ([a, b]; M. r ) is fixed and the functional is to be minimized only over £(■), 
z{-) (the state variables) and v(-) (the control variable). 



Problem (P T [w(-)]). 

K [*(•), *(■), <)] = / P(r, i(r), z(r), v(r)) dr — ► min 



*(■) e Wi.00 (k 6]; M) , *(■) G ([a, 6]; M n ) 
«(■) €Loo([o, 6]; [0.5, 1.5]) 

U'{t)=v{t) 

\z'(r) = /(r, t(r), z(r), v(r)) 
f(a) = a, t(6) = 6 
2(0) = A, z(b) =B, 



where P(r, t, z, v) = L (t, z, w(t)) v, /(r, t, z, v) = tp (t, z, w(t)) v. 
Remark 3. Problem (P T ) is autonomous while (P) and (P T [u;(-)]) are not. 

The relation between problem (P) and problem (P T [w(-)]) is discussed 
in the following two sections. 



data ([[]), will be used. 



<(•) 6 Wi >00 ([a, 6]; M) , z(-) € W lA ([a, 6]; M n ) 
«(■) G ^00 ([a, 6]; [0.5, 1.5]) , «;(•) G L x ([a, 6]; M r ) 




z'(t) = <p(t(r), z(t), w(t)) v(t) 
t( a ) = a, t(b) = b 
z(a) = A, z(b) = B . 



(3) 
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3 Relation Between the Solutions of the Problems 



Let us begin to determine the relation between admissible pairs for problem 
(P) and admissible quadruples for problem (P T ). 

Definition 4. The pair (x(-), u(-)) is said to be admissible for (P) if all 
conditions in (||) are satisfied. Similarly, (t(-), z(-), «(■), w(-)) is said to be 
admissible for (P T ) if all conditions in (|3|) are satisfied. 

Next lemma specifies a passage from an admissible state-control pair of 
the problem (P) to an admissible state-control pair of the problem (P r ). 
Importantly, the values of the two problems are the same. 

Lemma 5. Let (x(-),u(-)) be admissible for (P). Then, for any function 
v(-) satisfying 

v(-) GLooQo, 6]; [0.5, 1.5]), (4) 

b 

v(s) ds = b — a, (5) 

t(r) = a + JJ~v(s)ds, z(t) = x(t(r)) and w(t) = u(t(r)), are such that 
(t(-), z(-),v(-),w(-)) is admissible for (P T ). Moreover, 

J[t(-),z( : ),v(.),w(-)]=I[x( : ),u(-)]. (6) 

Proof. All conditions in (^) become satisfied: 

• Function t(-) is Lipschitzian: = v(-) € ([a, b]; [0.5, 1.5]); 

• Function z(-) is absolutely continuous since it is a composition of the 
absolutely continuous function x(-) with the strictly monotonous Lip- 
schitzian continuous function t(-): 

^ = *M>0; (7) 

• Function w(-) is Lebesgue measurable, w(-) S L\, because u(-) is mea- 
surable and t(-) is a strictly monotonous absolutely continuous func- 
tion; 

• Differentiating z(-) we obtain: 

_ dz(r) _ dx(t(r)) dt(r) 
[ >~ dr " dt dr ' 
In view of (|2|) and (|7|), one concludes from this last equality that 

z'(T) = ip(t(r), x(t(r)), u(t(r))) v(r) 
= <p(t(r), z(t), w(t)) v(t); 
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• From (|5|) and from the definition of t(r) we have t(a) = a and tib) = b. 
It follows that 

z(a) = x (t(a)) = x(a) = A; 
z{b) =x(t(b)) =x(b) = B. 

It remains to prove equality (||). Since 

J [*(•), z(-), v(-), <)] = f L(t( T ), z(t), w(t)) V (r)dr 

J a 
rb 



I 

■J a 



L(t(r), x(t(r)), u(t(T)))v(r)dT, (8) 

from the change of variable t(r) = t, 

dt = v(t) dr 

t = a ^ t = a (9) 
_r = b O t = b, 

it follows from (||) the pretended conclusion: 

J [*(•), z(-), «(•), «;(•)] = ['Lit, x(t), u(t)) dt = I[x(-), u(-)] . 

J a 

□ 

The passage established by Lemma |5| is not unique because, compared 
to (P), problem (P T ) has one more state variable and one more control 
variable. However, as far as the right-hand side of the control system for the 
problem (P T ) is autonomous, does not depend on r, the set of admissible 
state-control pairs of (P T ) is invariant under translations of r. Lemma ^ 
asserts that to each admissible state-control pair for (P T ) there corresponds 
a unique state-control pair for the problem (P) with the same value for the 
cost functionals. 

Lemma 6. Let (t(-), z(-), v(-), w(-)) be admissible for (P T )- Then the pair 
(x(-), u(-)) = (z (t(-)) , w(t(-))), where r(-) is the inverse function oft(-), 
is admissible for (P) . Moreover 

I[x(.),u(-)] = J[t(-),z(.),v(-),w(-)]. (10) 

Proof. Similar arguments to the ones in the proof of Lemma @, show that 
function x(-) is absolutely continuous and that u(-) S L\ ([a, b]; W). Differ- 
entiating x(-) we obtain: 

. _ dx(t) _ dz (r(t)) dr(t) 
X[) ~ dt dr dt ' 
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and from (||), and from the fact that —^p- = v (r(t)) ^ ^> one conc hides that 

m = = v (t? s(t)) u(t)) . 

V(T{t)) 

As far as r(a) = a and r(6) = b, it comes x(a) = z(r(a)) = z(a) = A, 
x(b) = z (r(6)) = = P, and all conditions in (Q) are satisfied. Equality 
( [ToD follows by direct calculations from the change of variable r(t) = r and 
relations (|9|): 

I [*(•), «(•)] = / L(t, x(t), u(t)) dt= f L(t(r(t)), z(r(t)), u>(r(i))) di 

JO JO 

L(t(r), z(r), u;(r)) ^(r)dr = J [*(■), *(•)> <), ">(')] • 

□ 

From Lemmas |5] and ^, the following two corollaries are obvious. They 
establish the relation between the minimizers of problems (P) and (P T ). As 
a consequence, solving the problem (P) turns out to be the same as solving 
the problem (P T ). 

Corollary 7. If (x(-), u(-)) is a minimizer of problem (P), then, for any 
function v(-) satisfying (|j) and @ (e.g. v{r) = 1), the 4-tuple 

(*(•), z(), «(•), w(-)) , 

defined by t{r) = a + f^v(s)ds, z(t) = x(i(r)), w(t) = u(i(r)), is a 
minimizer to problem (P r )- 

Corollary 8. If (£(•), z(-), v(-), w(-)) is a minimizer of problem (P T ), then 
the pair (x(-), u(-)) defined from (i(-), z(-), v(-), w(-)) as in Lemma ^ is a 
minimizer to problem (P). 

Thus, let (x(-), u(-)) be a minimizer of problem (P). From Corollary [?] 
we know how to construct a minimizer (£(•), £(•), £(•), to problem 

(P T ). Obviously, as far as problem (P T [w(-)]) is the same as problem (P T ) 
except that w() is fixed, (t(-), z(-), v(-)) furnishes a minimizer to problem 
(P T Choosing v(t) = 1 we obtain. 

Proposition 9. If (x(-), u(-)) is a minimizer of problem (P), then the triple 
(t(r), z(t), v(r)j = (r, x(t), 1) furnishes a minimizer to problem (P T [u(-)]). 

Proposition ^ gives a minimizer to problem (P r [tt(-)]), where u(-) is an op- 
timal control to the corresponding problem (P). As far as for the problem 
(P T [«(•)]) the admissible controls are already bounded, one can check that 
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the pertinent hypotheses on functions F and / (on functions L and ip) 
required by the Pontryagin maximum principle are valid, that is, one can 
obtain conditions under which (t(r), z(t), u(t)) = (r, x(t), 1) is a Pontrya- 
gin extremal. To conclude that the original minimizer (x(-), u(-)) of (P) is 
also an extremal, one needs to know how the extremals of the problems are 
related. This will be addressed in the next section. 



4 Relation Between the Extremals 



At the core of optimal control theory is the celebrated Pontryagin maxi- 
mum principle. The maximum principle is a first order necessary optimality 
condition for the optimal control problems. It first appear in the book |27fl . 
Since then, several versions have been obtained by weakening the hypothe- 
ses. For example, in [27] it is assumed that functions L(-,-,-) and <p(-,-,-) 



are continuous, and have continuous derivatives with respect to the state 
variables x: L(t,-,u), ip(t,-,u) £ C . Instead of the continuity assumption 
of L(-, •, •) and cp(-, •, •), a version only requiring that functions L(-,x,-) and 
(p(-,x,-) are Borel measurable can be found in book [|], Ch. 5]. There, in 
order to assure the applicability of the maximum principle, the following 
assumption is imposed: there exists an integrable function q(-) defined on 
[a, b] such that the bound 



dL 

— (t,x,u(t)) 



dx 



(t,x,u(t)) 



< a(t) 

< a(t) 



(11) 
(12) 



(i = 1, . . . , n) holds for all (i, x 
ity of a(-), and the bound ([ill) 



' £ [a, b] xR". The existence and integrabil- 
-(|i"2|), are guaranteed under the hypotheses 
that L and ip possess derivatives §^ and ^ which are continuous in (t, x, u), 
and u(-) is essentially bounded (these are the hypotheses found in [^]). Al- 
ternative hypotheses are the following growth conditions (see |8|, Sec. 4.4 
and p. 212]): 



dL 

dx 



< c\L\ + k, 



dipi 



dx 



< c \ifi\ + k , 



(13) 



with constants c and k, c > 0. In the context of the Lipschitzian regularity, 
conditions (jl^) are particularly important: they are easy to check in prac- 
tice. Those who are familiar with the Lipschitzian regularity conditions for 
the basic problem of the calculus of variations (<p(u) = u), will recognize 
( |T3D as a generalization and a weak version of the classical Tonelli-Morrey 
Lipschitzian regularity condition (cf. e.g. p^, §7.1]) where no restriction is 
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imposed to 

Tonelli-Morrey Lipschitzian regularity condition. If the Lagrangian 
L satisfies the growth condition ||^|| + ||§^|| < c\L\ + k, c > 0, then any 
solution x(-) to the basic problem of the calculus of variations, in the class of 
absolutely continuous functions, is indeed Lipschitzian (u(-) = x(-) € Loo) 
and satisfy the Pontryagin maximum principle. 



From the fact that (|13| ) is a generalization of the Tonelli-Morrey Lips- 
chitzian regularity condition, one can guess a link between the applicability 
conditions of the maximum principle and the Lipschitzian regularity con- 
ditions. The link between the applicability conditions of the classical Pon- 
tryagin maximum principle |27j and the Lipschitzian regularity conditions 
for optimal control problems with control-affine dynamics, was established 



in [28] using a reduction of the problem to a time-minimal control problem. 
Here, to deal with general nonlinear dynamics, we use completely different 
auxiliary problems and we will need to apply the maximum principle under 



weaker hypotheses than those in 27]. This is due to the fact that when we 



fix w(-) G Li ([a, &]; M r ), functions F(t, t, z, v) and f(r, t, z, v) of problem 



(P T [w (•)]) are not continuous in r but only measurable. Hypotheses (|13[) are 
suitable, as far as they can be directly verifiable for a given problem. Weaker 
hypotheses than (11) and (O) can also be considered. In this respect, im- 



portant improvements are obtained from the use of nonsmooth analysis. For 
example, one can substitute ( p"T| ) and (|l2|) by the weaker conditions 

\L (t, xi, u(t)) — L (t, X2, u(t)) \ < a(t) \\xi — x%\\ (14) 
\tpi (t,x 1 ,u(t)) - ifi (t,x 2 ,u(t))\ < a(t) \\x-l - x 2 \\ 

and formulate the maximum principle in a nonsmooth setting, in terms of 
generalized gradients (see |?|, H]) . Proving general versions of the maximum 
principle under weak hypotheses is still in progress and the interested reader 
is referred to the recent paper |3(i| ]. 

Definition 10. Let (x(-), u(-)) be admissible for (P). We say that the 
quadruple (x(-), n(-), ^Cb "0("))> V'o € Mq and %/)(■) € Wi,i ([a, b}; M n ), is an 
extremal of (P), if the following two conditions are satisfied for almost all 
t G [a, b]: 

the adjoint system 

dH 

i>(t) = (t, a?(<). «(*), V-o, m) ; (is) 

the maximality condition 

H (t, x(t),u(t),ipo,ip(t)) = sup H (t, x{t), u, ip , ; (16) 
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where the Hamiltonian equals 

H (t, x, u, ip , VO = V>o L(t, x,u) + if)- <p(t, x, u). 

Definition 11. Let (t(-), z(-), v(-), to(-)) be admissible for (P r ). The 7- 

tuple (£(•), z(-), u(-), w(-), Pa, MO, Pz{-)), Po 6 R , pt(0 G ^i,oo ([«,&]; R) 
and p 2 (-) € Wi, i ([a, 6]; M n ), is said to be an extremal of (P T ), if the following 
two conditions are satisfied for almost all r G [a, &]: 

the adjoint system 

dn 

p '^ T "> = — 7u ( t(r )> z ( r )' u ( r )' p *( r )' ^( r )) ' 

m (17) 

PU T ) = —fc ( t ( T ), Z ( T )> u ( r ), w ( T )i Po, Pt(r), Pz(t)) ; 
the maximality condition 

H (t(r), z(t), v(t), w{t), po, p t (r), p z {r)) 

= sup H(t(r), z(t), v, w, p , p t (r), p z (r)); (18) 
ve[0.5, 1.5] 
toGR r 

where the Hamiltonian equals 

H (t, z, v, w, po, p t , p z ) = (po L (t, z, w) +p t +p z ■ (f (t, z, w)) v. 

Remark 12. Functions H and 7i, respectively the Hamiltonians in Defini- 
tions pi] and 11, are related by the following equality: 

H (t, z, v, w, po, p t , p z ) = (H (t, z, w, po, p z ) +p t ) v . (19) 

From it one concludes that 

dH _ dH 

~dt ~~dt 
dH dH 



* (20) 



0. fa"" (21 > 

Definition 13. An extremal is called normal if the cost multiplier (^o in 
the Definition |l^ and po in the Definition |j"T| ) is different from zero and 
abnormal if it vanishes. 

Remark 14. As far as the Hamiltonian is homogeneous with respect to the 
Hamiltonian multipliers, for normal extremals one can always consider, by 
scaling, that the cost multiplier takes value —1. 
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Remark 15. The (Pontryagin) maximum principle give conditions, as those 
discussed in the introduction of this section, under which to each minimizer 
of the problem there corresponds an extremal with Hamiltonian multipliers 
not vanishing simultaneously ((ipo, tp) 7^ in the Definition [l(] and (po, p) ^ 



in the Definition 11). 

One can expect the set of extremals of problem (P r ) to be richer than 
the set of extremals of problem (P). Nevertheless, there is a relationship 
between the extremals of the problems. Next lemma shows that to each 
extremal of problem (P) there corresponds extremals of problem (P T ) lying 
on the zero level of the maximized Hamiltonian TL. 

Lemma 16. Let (x(-), u(-), -0o> V'(')) be an extremal of (P). Then, for any 
function v(-) E {[a, &]; [0.5, 1.5]) satisfying J^v(s)ds = b — a, the 7-tuple 
(*(■)> v (-), w i-), Po, Pt(-), Pz{-)) defined by 



t(r) = a + v(s) ds 

J a 



z(t) = x(t(T)) , w(t) = u(t(r)) , 
Po = ^o, Pz{r) = ip(t(r)) , 
Pt (r) = -H{t{r), x(t(r)l u(t(r)), Vo, m-r))) 

is an extremal of (P T ) with TL (t(r), z{f), v(t), w(t), po, pt(T~), p z (r)) = 0. 

Proof. From Lemma || we know that such 7-tuple is admissible for (P T ). The 
maximality condition ( |i~8| ) is trivially satisfied since we are in the singular 
case: from (|l9|) the Hamiltonian TL vanishes for p t = —H(t, z, w, po, p z ). 
It remains to prove the adjoint system (|l7|). Since ^ = @M- along the 



extremals (see e.g. [27] or Q) the derivative of pt(r) with respect to r is 
given by 

dp t dH _ dH dt _ dH dt __ dH 

dr dr dt dr dt dr dt 

From relation (^) the first of the equalities (|l~7| ) is proved: p' t = —jjf- 
Similarly, as far as p z (r) = ip (t(r)) and from ( |i~5| ) -^^{t) = — it follows 
from © that p' z = « § = -g v = □ 

It is also possible to construct an extremal of problem (P) given an 
extremal of (P T ). 

Lemma 17. Let (t(-), z(-), v(-), w(-), po, pt{ ), Pz(')) be an extremal of(P T ). 
Then (x(-), u(-), ip , ip(-)) = (z (r(-)) , w (r(-)) , p , p z (r(-))) is an extremal 
of (P) with t(-) the inverse function of t{-). 
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Proof. From Lemma [] we know that the pair (x(-), is admissible for 
(P). Direct calculations show that 

■ d dp z (r) dr 1 

V = ~nPz\ T ) = — -77 = — » — • 
dt dT di v 

From ( pl[ ) the required adjoint system is obtained: ^ = — Maximality 
condition ( |i~8| ) implies that 

H(t(r), z(t), v(t), w(t), po, pt(r), p z {j)) 

= sup H(t(r), z{t), v(t), w, p , p t (r), Pz(t)) 



for almost all r G [a, b]. Given the relation (19) one can write that 
H(t(r), z(t), w(t), po, p z {r)) = sup H(t{r), z{t), w, p , Pz{t)) ■ 

Putting r = r(t) we obtain the maximality condition (|l6|). □ 

Lemmas [l6| and [l?] establish a correspondence between abnormal ex- 
tremals of problems (P) and (P T ). 

Corollary 18. If there are no abnormal extremals of problem (P) then 
there are no abnormal extremals of problem (P T )- If there are no abnormal 
extremals of (P T ) then there are also no abnormal extremals of(P). 

Definition 19. We call a control an abnormal extremal control if it corre- 
sponds to an abnormal extremal. 

Proposition 20. If (x(-), u(-)) is a minimizer of problem (P) and n(-) is 
not an abnormal extremal control, then the minimizing control v = 1 of 
Proposition || is not an abnormal extremal control too. 



In the next section we will use Proposition 2C to show that, for non- 
abnormal minimizers, the Lipschitzian regularity conditions we are looking 
for, assuring that the minimizing controls, predicted by Tonelli's existence 
theorem, are indeed bounded, appear from the applicability conditions of 
the maximum principle to problem (P T [u(-)]). 



5 The General Regularity Result 

Filippov fi~8[| gave the first general existence theorem for optimal control 
(the original paper, in russian, appear in 1959). There exist now an exten- 
sive literature on the existence of solutions to problems of optimal control. 
We refer the interested reader to the book ||] for significant results, various 
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formulations, and detailed discussions. Follows a set of conditions, of the 
type of Tonelli , that guarantee existence of minimizer for problem (P) . 



"Tonelli" existence theorem for (P). Problem (P) has a minimizer 
(x(-), u(-)) with u(-) € L\ ([a, &]; M r ), provided there exists at least one ad- 
missible pair, functions L(-, •, •) and <p(-,-,-) are continuous, and the following 
convexity and coercivity conditions hold: 

(convexity) Functions L(t,x, •) and (p(t,x, •) are convex for all (t, x); 

(coercivity) There exists a function 8 : Rq — > M., bounded below, such 
that 

L(t,x,u)>9(\\ip(t,x,u)\\) for all (t,x,u); (22) 

lim = +oo; (23) 

r— >+oo r 

lim x, = +oo for all (t, x). (24) 

[till — »+oo 



Remark 21. For the basic problem of the calculus of variations one has 
if = u and the theorem above coincides with the classical Tonelli existence 
theorem. 

Analyzing the hypotheses of both necessary optimality conditions and 
existence theorem, one comes to the conclusion that the requirements of 
existence theory do not imply those of the maximum principle. Given a 
problem, it may happen that the necessary optimality conditions are valid 
while existence is not guarantee; or it may happen that the minimizers 
predicted by the existence theory fail to be extremals. Follows the main 
results of the paper. 

Theorem 22. Under the above hypothesis of coercivity, all control mini- 
mizers u(-) of (P), which are not abnormal extremal controls, are essentially 
bounded on [a, b] if the applicability conditions of the maximum principle (for 
example (|i~3|), (|TT|) — ( 12) or (14)) to functions F and f of problem (P T [u(-)]) 



are 



assured^ 



Remark 23. Convexity is not required in the regularity result of Theorem 
in order to establish the Lipschitzian regularity of the (non-abnormal) mini- 
mizing trajectories x(-). Convexity is only required to establish the existence 
of minimizers, not the regularity. This fact is important since existence the- 
orems without the convexity assumptions are a question of great interest 



(see e.g. [26] and the references therein). 



1 A precise statement of possible regularity conditions are found in Theorem ^ij. 
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Applying the hypotheses fll3| ) of the maximum principle to functions F 
and / of problem (P r [«(•)]), the following result is trivially obtained. 

Theorem 24. Under the hypothesis of coercivity, the growth conditions: 
there exist constants c > and k such that 



dL 



dt 

dip 



dt 



< c\L\ + k, 

< c \\<p\\ + k , 



dL 



dx 

dip. 



dx 



< c\L\ + k, 
< c \ipi\ + k 



imply that all minimizers u(-) of (P), which are not abnormal extremal con- 
trols, are essentially bounded on [a, b]. 

In the special cases of a time-invariant linear control system, or for the 
problems of the calculus of variations, Theorem 24 gives the typical growth 
conditions, of the type of Tonelli-Morrey, obtained in previous results fl3| , 
15, O]. For the case of control-afnne dynamics, the growth condition of 



Theorem |] is less restrictive. 

A minimizer {£(■) which is not essentially bounded may fail to satisfy the 
Pontryagin Maximum Principle. As far as essentially bounded minimizers 
are concerned, the Pontryagin Maximum Principle is valid. 



Theorem 25. Under the hypotheses of Theorem 2^, all minimizers of (P) 
are Pontryagin extremals. Furthermore, it is valid a weaker form of the 
Pontryagin maximum principle in which the adjoint multipliers ip(-) are not 
required to be absolutely continuous, but are required instead to be merely 
Lipschitzian. 



Proof. (Theorem Let (x(-), u(-)) be a minimizer of (P). From Proposi- 
tions ^ and |20| and by the assumptions of the theorem, we know that there 
exist absolutely continuous functions pt(-) and p z (-) such that for almost all 
points t £ [a, b] 



v i — > [-L{t, x(t), n(r)) +p t (r) + p z (r) -ip{T, x(t), u(t))] v 
is maximized at v = 1 on the interval [0.5, 1.5]. This implies that 
L(r, x(t), u(t)) =pt{r) + p z (r) -tp(r, x(r), n(r)) . 



(25) 



Let (t) I < M and ||p z (t)|| < M on [a, b]. Dividing both sides of inequality 
(25) by \\ip(r, x(t), u(t))\\ and using the coercivity hypothesis ([22]), one 



obtains 

e(\\ip(T, x(T),u(r)\ 
\\ip(T, x(t), u(t)) 

The coercivity condition (p3|)-i 
on [a, b]. 



< M 



1 + \\ip(T, x(t), u{t) 



<p(r, x(t), u(t))\\ 

yields the essential boundedness of u(-) 

□ 
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6 An Example 



As far as Theorem 24 is able to cover optimal control problems with dy- 
namics which is nonlinear both in the state and in the control variables, 
plenty of examples possessing minimizers according to the existence theory 
can be easily constructed for which our result is applicable while previously 
known Lipschitzian regularity conditions, such as those in [14] and p8[| , fail. 
Follows one such example with n = r = 2. 



Example 26. 



(u 2 (t) + u 2 (t)) (e 2 ^ +x ^ + l) dt 



mm 



x\{t) = y/ul(t) + ul(t) 

X2(t) = Mt)e Xl(t)+X2(t) 
xi (0) = 0, xi(l) = 1, i 2 (0) = 1, x 2 (l) = 1. 



Here we have: 



/ o 2 



2 (x!+x 2 ) 



+ 1 



Vi" 




V u i + u 2 


_(f2_ 




u 2 e Xl+x \ 



L(x 1 ,x 2 ,ui,u 2 ) = 

ip(xi,X2,U 1 ,U 2 ) 



Clearly, all conditions of Tonelli's existence theorem are satisfied: an admis- 
sible quadruple is (xi(t), X2{t), u\(t), U2(t)) = (i, 1, 1, 0); functions L(-, •) 
and ip{-, •, •, •) are continuous in R 4 ; function L(x\,X2, •, •) is strictly convex; 
(p(xi,X2, •, •) is convex; from the inequality L = (u\ + u|) (e 2 ( Xl + x v + l) > 
u\ + u?, + u 2 e 2 ( Xl+X2 '> we have quadratic coercivity (0(r) = r 2 ). There- 
fore the problem has a solution for xi(-) ,%2(-) € Wi,i ([0, 1]; R) and iti(-), 
^2(0 ^ -^1 ([0, 1]; M). Smooth assumptions on data (||) are satisfied, since 
L(-, ■,-,■) and y>(-, •, ui, U2) are of class C°°. Theorem ^4| allow us to conclude 
that all minimizing controls, which are not abnormal extremal controls, are 
bounded: 



The conditions on and ^ are trivially satisfied as far as the problem 



is autonomous: L and 99 do not depend explicitly on the time variable. 

9L „„j dp „„„ „ lr ,„ <9L _ 5L 

dt£\ _ dpi _ n . 8ip2 _ dpi 



• The growth conditions on ^ and ^ are also satisfied: = = 
2e^+-) (ul + u 2 ) < 2L; ga = % = 0; = gg = ^. ' 

Unbounded minimizers, if there are any, are abnormal extremal controls 



From Theorem 25 all minimizing controls of the problem (normal or abnor- 
mal) can be identified via the Pontryagin maximum principle. 
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7 Final Remarks 



In this paper we study properties of minimizing trajectories for general prob- 
lems of optimal control in the cases where controls are unconstrained (like 
in the calculus of variations). We provide conditions which guarantee Lips- 
chitzian regularity of the minimizing trajectories for the Lagrange problem 
of optimal control in the general nonlinear case. These conditions solve the 
discrepancy between the optimality and existence results, assuring that min- 
imizers predicted by the existence theory satisfy the optimality conditions. 
At the same time, undesirable phenomena, like the Lavrentiev one, are nat- 
urally precluded. We show that the conditions of Lipschitzian regularity are 
related with the applicability conditions of Pontryagin's maximum princi- 
ple. To deal with dynamics which are control-affine, the classical Pontryagin 
maximum principle |27]] is enough (see p8[ ). To treat the general case, a 
maximum principle under weak assumptions, like the one in |||, is necessary. 
Our approach is based on the relationship of the extremals of the Lagrange 
problem with the extremals of an auxiliary problem, and on the subsequent 
utilization of Pontryagin's maximum principle to the later problem. The 
maximality condition of Pontryagin's maximum principle together with the 
coercivity assumption of the existence theorem imply the Lipschitzian regu- 
larity of the corresponding minimizer of the original problem. This approach 
allows us to deal with more general class of problems of optimal control with 
nonlinear dynamics. 

It remains to clarify the interconnection between Lipschitzian regularity 
and abnormal extremality. For the problems of the calculus of variations 
studied in [13] and (l5j no abnormal extremals exist. For the optimal control 
problems considered in [14| and [28], abnormal extremals are, like here, 
put aside. The question of how to establish Lipschitzian regularity for the 
abnormal minimizing trajectories seems to be a completely open question. 
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